In the Claims : 

Please cancel Claims 2, 3, 9, and 27, replace Claims 1, 4, 6, 7, 10, 13, 20-22, 28, 29, and 30 
and add new Claim 3 1 , all as shown below. 



1 . (Currently Amended) : A method, comprising the step of : 

warping a set of images synchronously captured from a camera array into a common 
coo r dinate system of a composite image; 

synchronously capturing a set of images from a camera array: 
selecting pixels from at least one image of said set of images: 

applying a bilinear transformation to the selected pixels to transform the selected pixels from 
a coordinate system of the at least one image to a common coordinate system of a composite image . 

2. (Cancel) 

3. (Cancel) 

4. (Currently Amended): The method according to claim 1, wherein said step of 
warping selecting pixels comprises the steps of : 

identifying a set of contiguous patches in each of said imagesrand 
warping e ach patch into said common coordinate system . 
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5. 



(Original): The method according to claim 4, wherein said step of identifying 



patches, comprises: 

identifying regions in each image having registration points in common with said composite 

image. 

6. (Currently Amended): The method according to claim 4, wherein said step of 
warping, includes the step of further comprising : 

combining patches from different images of said set of images having a same set of 
registration points into a same corresponding location of said composite image. 

7. (Currently Amended): The method according to claim 6, wherein said step of 
combining comprises the step of: 

cross-fading patches from different images of said set of images having a same set of 
registration points into a same corresponding location of said composite image. 

8. (Original): The method according to claim 6, wherein said step of combining 
includes at least one of cross-fading, blurring, averaging, and other image effects to seamlessly 
combine said patches from different images having a same set of registration points into a same 
corresponding location of said composite image. 



9. 



(Cancel) 
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10. (Currently Amended): The method according to claim 9 4, wherein said step of 
performing a transformation comprises: 

applying a predetermined bilinear transformation matrix to each patch, said predetermined 
bilinear transformation matrix representing an amount of warping required for each patch to 
transform each patch into said common coordinate system. 

11. (Original): The method according to claim 7, wherein said step of cross-fading 
comprises the steps of: 

varying a parameter of each pixel of a first patch from minimum value at a first boundary of 
said first patch to a maximum value at an opposite boundary of said first patch; 

varying said parameter of each pixel of a second patch from said maximum value at a 
boundary of said second patch corresponding to said first boundary to said minimum value at a 
boundary of said second patch corresponding to said opposite boundary; 

summing each of corresponding pixel values of each said first patch and said second patch; 

and 

placing the summed values in corresponding locations of said common coordinate system. 

12. (Original): The method according to claim 1 1 , wherein said parameter is at least one 
of brightness, contrast, and intensity. 

1 3 . (Currently Amended) : The method according to claim 1 , further comprising the step 
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repeating said step of warping applying a transformative equation for each set of images 
synchronously captured by said camera array, each set of images representing one frame in a video 
stream of said scene. 

14. (Original): The method according to claim 1, further comprising the steps of: 
selecting an area of interest from the composite image; and 

outputting the selected area of interest to a user. 

15. (Original): The method according to claim 14, wherein said step of outputting 
comprises the step of displaying said area of interest from the combined warped images. 

16. (Original): The method according to claim 14, wherein said step of selecting 
comprises: 

directing said area of interest to a predetermined area surrounding at least one of motion 
detected in said scene, audio sources detected within said scene, and proximity of objects detected 
in said scene. 

1 7. (Withdrawn): A method of controlling a virtual camera having a view selected from 
an array of cameras, comprising the steps of: 

combining images from each of said cameras into a panoramic view; 

detecting motion in said panoramic view; and 

directing a view of said virtual camera based on said motion. 
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18. (Withdrawn): The method according to claim 1 7, wherein: 
said method further comprises the step of: 

ranging objects in said panoramic view by stereoscopically calculating a range of said 
objects; and 

said step of directing comprises directing a view of said virtual camera based on the motion 
detected and a range of said objects. 

19. (Withdrawn): The method according to claim 18, wherein: 
said method further comprises the steps of: 
retrieving audio inputs from a set of directive microphones, and 
determining a direction of said audio inputs within said panoramic view; and 
said step of directing comprises directing a view of said virtual camera based on at least one 

of said motion, a range of said objects, and a direction of said audio inputs. 

20. (Currently Amended): A camera array, comprising: 
a set of cameras mounted in an array; 

an image combining mechanism configured to combine at least two of images captured from 
said set of cameras into a composite image , the image combining mechanism including: 



system of said composite image by applying a bilinear transformation : 

a view selection device configured to select a view from the composite image; and 
an output mechanism configured to display the selected view. 



a warping device configured to warp patches of each image into a common coordinate 
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21 . (Currently Amended): The camera array according to claim 20, wherein [[:]] said 
image combining mechanism includes, 

a warping devic e configured to warp patches of each image into a common coo r dinate system 
of said composite imag e , and 

a fading device configured to fade and combine patches having a same location in said 
composite image. 

22. (Currently Amended): The camera array according to claim 20, wherein said frame 
view selection device includes: 

at least one of, 

a video motion detector configured to detect motion in the composite image, 

a sound detection device configured to determine a location of sound originating 
within said composite image, and 

a stereoscopic ranging mechanism configured to utilize at least two images from 
separate cameras of said camera array to determine a range of objects in said composite image; and 

a detection mechanism configured to automatically detect any of a face, shape, color, 
and motion of a subject for inclusion in said selected frame based on at least one of ranging data 
from said stereoscopic ranging mechanism, location data from said sound detection device, and 
motion detected by said video motion detector. 

23. (Original): The camera array according to claim 21, wherein: 
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said array of cameras are immovably mounted on a firm fixed base; and 

said warping device applies a pre-determined transformation to each of said patches. 

24. (Original): The camera array according to claim 2 1 , further comprising a registration 
mechanism configured to register each of said camera arrays by finding registration points in 
common with views of each camera and said composite image. 

25. (Original): The camera array according to claim 24, wherein said registration device 
comprises: 

a registration point source directable to locations within each camera view; and 

a detection mechanism configured to detect said registration point source and register the 

detected registration point source in each of said camera views with respect to a coordinate system 

of said composite image. 

26. (Original): The camera array according to claim 25, wherein said registration point 
source is at least one of a light source directed into view of said camera array and a grid placed in 
view of said camera array. 
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27. (Cancel) 

28. (Currently Amended): The method according to claim 2? 30, wherein said step 
placing comprises the steps of: 

sweeping an beam light source across a field of view of at least two cameras of said camera 

array. 

29. (Currently Amended): The method according to claim 2? 30, wherein said step of 
placing comprises the step of: 

placing a grid of known location in a field of view in at least two cameras of said array. 

30. (Currently Amended): The A method acco r ding to claim 27, whe r ein said st e p of 
maintaining information comprises the steps of of registering a camera array, comprising : 

placing at least one registration point in a field of view of at least two cameras of said camera 

array: 

identifying a location of each registration point in a field of view of each camera of said 

array: 

calculating a warped coordinate system for placing pixels of said cameras; and 
maintaining a table identifying pixels of said cameras, an amount of fade, and a 

corresponding location in the warped coordinate system such that images can be combined in 

relation to said registration points . 
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3 1 . (Newly Added): A method, comprising: 
synchronously capturing a set of images from a camera array; 
selecting pixels from at least one image of said set of images; and 

applying a transformative equation to the selected pixels to transform the selected pixels from 
a coordinate system of the at least one image to a common coordinate system of a composite image; 

wherein said transformative equation is at least one of a bilinear transformation, a radial 
transformation, and an affine transformation. 
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